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[57] . ABSTRACT 

Apparatus is described for processing a digitized image 
signal obtained from an image sensor having color photo- 
sites aligned in rows and columns that generate at least three 
separate color values but only one color value far each 
photosite location, and a structure for interpolating color 
values for each photosite location so that it has three 
different color values. The apparatus includes a memory for 
storing the digitized image signal and a processor operative 
with the memory for generating an appropriate color value 
missing from a photosite location by the interpolation of an 
additional color value for such photosite locations from 
color values of different colors than the missing color value 
at nearby photosite locations. The processor also includes 
structure for obtaining Lapladan second-order values, gra- 
dient values and color difference bias values in at least two 
image directions from nearby photosites of the same column 
and row and for adding the Laplacian second-order values, 
gradient values and color difference bias values to define a 
classifier and for selecting a preferred orientation for the 
interpolation of the missing color value based upon a 
classifier. Finally, a arrangement is provided for interpolat- 
ing the missing color value from nearby multiple color 
values selected to agree with the preferred orientation. 

19 Claims, 6 Drawing Sheets 
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ADAPTIVE COLOR PLANE values of different colors than the missing color value 

INTERPOLATION IN SINGLE SENSOR at nearby photosite locations, said processor including 

COLOR ELECTRONIC CAMERA means for obtaining Laplacian second-order values, color 

~ difference bias values, and gradient values in at least 

CROSS REFERENCE TO RELATED 5 tw 0 image directions from nearby photosites of the 

APPLICATIONS same column and row; 

Reference is made to commonly assigned U.S. Ser. Nos. means for adding the Laplacian second-order values, the 

08/407,436 filed Mar. 17, 1995 (U.S. Pat. No. 5,506,619) to color difference bias values, and the gradient values to 

James E. Adams, Jr. and John F. Hamilton, Jr. and 08/407, define a classifier and for selecting a preferred orien- 

423 filed Mar. 17, 1995 to John F. Hamilton, Jr. and James 10 tation for the interpolation of the missing color value 

E Adams, Jr. filed concurrently herewith, the teachings of based upon a classifier, and 

which are incorporated herein. means for interpolating the missing color value from 

1. Field of the Invention nearby multiple color values selected to agree with the 
This invention relates to the field of electronic imaging 15 preferred orientation. 

and is particularly suitable to electronic still imaging by use Advantages 

of an electronic still camera having a single color sensor and The advantages of this invention are 1) is computationally 

memory. efficient both in execution time and memory storage require- 

2. BACKGROUND OF THE INVENTION ments; and 2) by use of the combination of the Laplacian 
T " 1 *_ - * • on second-order values, gradient values and color difference 
Id electronic color imaging, it is desirable to simulta- *> ^ values to ce a ^ 

neously capture image data in three color planes, usually interpolation) in output image are substantially reduced 

red, green and blue. When the three color planes are ' 

combined, it is possible to create high-quality color images. BRIEF DESCRIPTION OF THE DRAWINGS 
Capturing these three sets of image data can be done in a 

number of ways. In electronic photography, this is some- 25 FIG * 1 ^ a block ^g^ 111 °** an electronic still camera 

times accomplished by using a single two dimensional array employing interpolation processing according to the inven- 

of sensors that are covered by a pattern of red, green and tl0n » 

blue filters, This type of sensor is known as a color filter FIG- 2 is a block diagram of the logic of the interpolation 

array or CFA. Below is shown the red (R), green (G) and processing technique used in connection with the invention; 
blue (B) pixels as are commonly arranged on a CFA sensor. 30 FIG. 3 is a detailed block diagram of the logic of the 

When a color image is captured using a CFA, it is interpolation luminance section in FIG. 2; 

necessary to interpolate the red, green and blue values so FIG. 4 is a more detailed block diagram of the logic of the 

that there is an estimate of all three color values for each chrominance section in FIG. 2; and 

sensor location. Once the interpolation is done, each picture nGS . 5 md 6 block diagrams for ^ inter . 

element^ or pixel, has three color values and can be pro- , TOeMes * accordance with the invention, 
cessed by a variety of known image processing techniques 

depending on the needs of the system. Some examples of the DETAILED DESCRIPTION OF THE 

reasons for processing are to do image sharpening, color INVENTION 

correction or halftoning. ~. . . , A 

. „ . * , 40 Since single-sensor electronic cameras employing color 

The following shows how red green and blue pixels can filter arrays are well known, the present description will be 
be arranged in a particular color filter array pattern, herein- directed in particular to elements forming part of, or coop- 
after referred to as the Bff^^f^^ * erating more directly with, apparatus and method in accor- 
detailed description see U.S. Pat No. 3,971,065 to Bayer. dance with me present invention. Hements not specifically 

45 shown or described herein may be selected from those 
known in the art 

Referring initially to FIGS. 1 and 2, an electronic still 
camera is divided generally into an input section 2 and an 
interpolation and recording section 4. The input section 2 
50 includes an exposure section 10 for directing image light 
from a subject (not shown) toward an Image sensor 12. 
SUMMARY OF THE INVENTION Although not shown, the exposure section 10 includes 

The object of this invention is to provide an improved conventional optics for directing the image light through a 
apparatus for estimating the missing pixel values in a CFA. ^#^8^ which regulates ^ optical apcrturej ^ a 
m.- u- * • u • ~i • \ * • 55 shutter, which regulates exposure time. The image sensor 12, 

This object is achieved in apparatus for processing a which indudes * ^dinfensional array of photosites c£ 
di^tizedmiagesi^ ^ to * * 

co or photosites aligned in rows and columns that generate Uonal ^ device (CCD) ^ ^ 

at least three separate color values but only one color value ^ OT ^ ^ j^ques. The 

for each photosite location, means for *^ok*ng color „ ^ sonsoiU is covered by ^ color m^m^y (CPA) 13 t 
different color values comprising: No ^ ism ^ M by ^ 

means for storing the digitized image signal; the Bayer geometry each color covers a photosite, or picture 

a processor operative with said storing means far gener- element (pixel), of the sensor. In particular, chrominance 
ating an appropriate color value missing from a pho- 65 colors (red and blue) are interspersed among a checkerboard 
tosite location by the interpolation of an additional pattern of luminance colors (green). The image sensor 12 is 
color value for such photosite locations from color exposed to image light so that analog image charge infor- 
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mation is generated in respective photosites. The charge "stack up" at video rates. The size of the buffer is established 

information is applied to an output diode 14, which converts to hold enough consecutive images to cover most picture- 

the charge information to analog image signals correspond- taking situations. 

ing to respective picture elements. The analog image signals An operation display panel 30 is connected to the control 

are applied to an A/D converter 16, which generates a digital 5 processor 20 for displaying information useful in operation 

image signal from the analog input signal for each picture of the camera. Such information might include typical 

element The digital signals are applied to an image buffer photographic data, such as shutter speed, aperture, exposure 

18, which may be a random access memory (RAM) with bias, color balance (auto, tungsten, fluorescent, daylight), 

storage capacity for a plurality of still images. field/frame, low battery, low ught, exposure modes (aperture 

A control processor 20 generally controls the input section 10 preferred, shutter preferred), and so on. Moreover, other 

2 of the camera by initiating and controlling exposure (by information unique to this type of camera is displayed. For 

operation by the Diaphragm and shutter (not shown) in the instance, the removable memory card 24 would ordinarily 

exposure section 10), by generating the horizontal and include a directory signifying the beginning and ending of 

vertical clocks needed for driving the image sensor 12 and each stored image. This would show on the display panel 30 

for clocking image information therefrom, and by enabling 15 as either (or both) the number of images stored or the 

the A/D converter 16 in conjunction with the image buffer 18 number of image spaces remaining, or estimated to be 

for each signal segment relating to a picture element (The remaining. 

control processor 20 would ordinarily include a micropro- The digital signal processor 22 interpolates each still 

cessor coupled with a system timing circuit.) Once a certain video image stored in the image buffer 18 according to the 

number of digital image signals have been accumulated in 20 interpolation technique shown in FIG. 2. Hie interpolation 

the image buffer 18, the stored signals are applied to a digital of missing data values at each pixel location follows the 

signal processor 22, which controls the throughput process- sequence shown in FIG. 2; that is, first, the high frequency 

ing rate for the interpolation and recording section 4 of the information for the "missing green" pixels (i.e., the red and 

camera. Hie digital signal processor 22 applies an interpo- blue pixel locations) are interpolated to improve the lumi- 

lation algorithm to the digital image signals, and sends the 25 nance rendition and, secondly, the color difference informa- 

interpolated signals to a conventional, removable memory tion is interpolated at the high frequency locations by 

card 24 via a connector 26. bilinear methods to generate the other colors of the CFA 

Since the interpolation and related processing ordinarily pattern. In the implementation shown in FIG. 2, an adaptive 

occurs over several steps, the intermediate products of the interpolation technique is used in the luminance section 36 

processing algorithm are stored in a processing buffer 28. 30 for optimizing the performance of the system for images 

(The processing buffer 28 may also be configured as part of with horizontal and vertical edges. 'Missing green"* pixels 

the memory space of the image buffer 18.) The number of are adaptively interpolated either horizontally, vertically or 

image signals needed in the image buffer 18 before digital two-dimenslonally depending upon the gradients, Laplacian 

processing can begin depends on the type of processing, that second-order values and color difference bias values estab- 

is, for a neighborhood interpolation to begin, a block of 35 lished from the neighboring pixel locations in the vertical 

signals including at least a portion of the image signals and horizontal directions around the "missing green" pixel, 

comprising a video frame must be available. Consequently, The first step for adaptively interpolating the '*missing 

in most circumstances, the interpolation may commence as green" pixels is to select an interpolation method. The 

soon as the requisite block of picture elements is present in details of this process are shown in block 40 of FIG. 3. The 

the buffer 18. 40 process starts by computing two composite pixel classifier 

The input section 2 operates at a rate commensurate with values in block 50, one for the horizontal direction and one 

normal operation of the camera while interpolation, which for the vertical. The term "pixel classifier*' denotes a value 

may consume more time, can be relatively divorced from the computed for the purpose of making a decision about further 

input rate. The exposure section 10 exposes the image sensor processing of the pixel information. The term "composite" 

12 to image light for a time period dependent upon exposure 45 denotes the dependency of the value on a multiplicity of 

requirements, for example, a time period between 1/1000 color planes. In this case, twice the absolute value of the 

second and several seconds. The image charge is then swept gradient of the green plane is added to the absolute value of 

from the photosites in the image sensor 12, converted to a the Laplacian second-order value of the red or blue plane, 

digital format, and written into the image buffer 18. The depending on which was the corresponding color in the 

driving signals provided by the control processor 20 to the 50 Bayer color filter array, and the absolute value of the color 

image sensor 12, the A/D converter 16 and the buffer 18 are difference bias value, which uses both green plane and, 

accordingly generated to achieve such a transfer. The pro- depending on which was the corresponding color in the 

cessing -throughput rate of the interpolation and recording Bayer color filter array, red or blue plane values, 

section 4 is determined by the speed of the digital signal The two classifier values are compared in block 51 versus 

processor 22. 55 a predetermined value hereinafter referred to as "the first 

One desirable consequence of this architecture is that the threshold value". If both classifier values are less than the 

processing algorithm employed in the interpolation and first threshold value, then the interpolation method corre- 

re cording section may be selected for quality treatment of sponding to slowly changing scene detail is selected in block 

the image rather than for throughput speed. This, of course, 52. "Slowly changing scene detail" means both horizontal 

can put a delay between consecutive pictures which may 60 direction classifier value and vertical direction classifier 

affect the user, depending on the time between photographic value are less than the first threshold value. If at least one of 

events. This is a problem since it is well known and the classifier values is greater than or equal to the first 

understood in the field of electronic imaging that a digital threshold value, both classifier values are compared in block 

still camera should provide a continuous shooting capability 53 to a predetermined value hereinafter referred to as "the 

for a successive sequence of images. For this reason, the 65 second threshold value". If both classifier values are greater 

image buffer 18 shown in FIG. 1 provides for storage of a than the second threshold value, then the interpolation 

plurality of images, in effect allowing a series of images to method corresponding to rapidly changing scene detail is 
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selected in block 54. "Rapidly changing scene detail" means 

both horizontal direction classifier value and vertical direc- Al 

tion classifier value are greater than the second threshold ° 2 

value. If at least one of the classifier values is less than or A3 G4 A5 G6 A7 

equal to the second threshold value, then the classifier values 5 ^ 

are compared in block 55 to each other. In the likely event 

that one of the classifier values is less than the other « . , . . . . _ . . . tl 

classifier value, the interpolation method corresponding to . G f 1 / i ^ cen P« d ™J £ u either a red pad or a blue 

the smaller classifier vatae in block 57 is chosen. If both P " e ^ , f ^ ^ r ^ ^ ^ 

classifier values are equal in value, then the default inter- 10 ^ b °*<>°d-> For sunpliciry we will use toe term 

polationmethodinblockStfischoseiLAttnispointblock^ ^ mean cither red or blue. We form the followmg 
is complete. 

The green (Tama) interpolation step in block 44 has two h=\-A3+us-A7*2\G4-G6* k*+2(A5+**h»si 

parts, as shown in FIG. 4. The first part in block 80 averages v=\-Al+2AS^A9\+2G2-G8k\<fc2(AS^)-G8\ 
the two luminance (green) values according to the selected 

interpolation method. The second part in block 82 adds a where 

correction factor based on either red or blue neighboring hh=tku iunw 

values depending on if the pixel in question was covered by " 

a red or blue filter in the Bayer color filter array and the bv=(bv'+A\-G\'y2 
interpolation method selected by block 40. 

where bh 1 is the previous value of bh along the same row, bv' 

The red/blue (chroma) interpolation proceeds in a manner is the previous value of bv along the same column and Gl* 

similar to the green (luma) interpolation described above. and G3' are previously predicted green values. Both bh and 

The details of this process are shown in Block 46 of FIG. 5. bv are initialized to zero at the beginning of the row/column. 

The process starts by determining if the two horizontally 25 (Note that as the algorithm is usually implemented to 

adjacent pixels to the pixel with the "missing" chroma value process the image row by row, bh can be a simple variable 

in question (either red or blue) are of the same color as the and bv is a one-dimensional array with an entry for each 

missing chroma value in block 60. If the two horizontally column). Note that Ax is either Rx or Bx. (All Ax's will be 

adjacent pixel values are the correct color, then the horizon- the same color). 

tal interpolation method in block 61 is used. If the two 30 These classifiers are composed of Laplacian second-order 

vertically adjacent pixels are of the same color as the values for the chroma data, gradient values for the green data 

"missing" chroma value in block 62, then the vertical and color difference bias values that use both chroma and 

interpolation method in block 63 is chosen. If neither green data. For example, for the classifier h, -A3f 2A5-A7 

horizontal or vertical interpolation methods have been is a Laplacian second-order value, G4-G6 is a green gradi- 

chosen, then compute two composite pixel classifier values 35 e m value and -G4+2(A5+bhM36 is a color difference bias 

in block 64, one for the negative diagonal direction and one value. As such, these classifiers are sensing the fr>h ^atkl 

for the positive diagonal. The term "negative diagonal" frequency information present in the pixel neighborhood in 

denotes the line of slope -1 (connecting the upper left to the tfl s fr prisontal (h\ and vertical (y) directions. 

lower right). The term "positive diagonal" denotes the line We then form four predictors. * 
of slope +1 (connecting the lower left to the upper right). 40 

Again, these composite classifiers are found by adding the A=(G2*G44GM&)/4 

absolute value of the Uplacian second-order value of Ac F^cz^^sy^-Ai-A^Ai^yn 

green plane to the absolute value of the gradient of either the 

red or blue plane, depending on which color is being H=«Hf06y2-K-A3+2A5-A7y4 

interpolated. 45 v^c72+csy2-K-Ai+Z45-A9y4 

The two classifier values are then compared in block 65 M M 

and tested for equality. In the likely event that one value is These Factors are composed of arithmetic averages for 

smaller than the other, the interpolation method correspond- ^ and > m * e ^ of , F > H 5 nd V ' appropriately 

mgtomesmaUavameissdectedmblock67.Ifmevakes scaled laplacian second-order values for the chroma data, 

are equal, then the default interpolation method is selected 50 E J ed £ 0r A * 10 be 1 used L when ^ 

in block 66. At this point Block 46 is done. classifier values are less than the first threshold value, T1.T1 

is chosen to reduce noise in the image reconstruction in 

The red/blue (chroma) interpolation step in block 48 has regions of slowly changing scene detail. An appropriate 

two parts, as shown in FIG. 6. In the first part in block 70 value for Tl is 25 when the green pixel values and chroma 

two chrominance values, either red or blue depending on the 55 pixel values range from 0 to 255. Predictor F is used when 

pixel's position in the Bayer color filter array, are averaged both horizontal and vertical classifier values are greater tha n 

according to the selected interpolation method. The second the second threshold value, T2. T2 is chosen to reduce noise 

part in block 72 adds a correction factor based on green in the image reconstruction in regions of rapidly changing 

neighboring values. scene detaiL An appropriate value for T2 is 200 when the 

Moresr** mc ally,me^^ 60 pixel values and chroma pixel values range from 0 to 

of the operation of the digital signal processor for a specific 255. Predictor H is to be used when the preferred orientation 

example using the Bayer array. f or me interpolation 13 m me faorHQflMfr^qn within the 

pixel neighborhood. Similarly, predictor V is to be used 

Green Plane Interpolation when me preferred orientation for the interpolation is the 

The first pass of the interpolation fully populates the green 65 vertical direction , 

color plane. The Bayer color filter array is assumed. Con- The complete green interpolation process may now be 

sider the following pixel neighborhood. expressed as below. 
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is blue and visa versa). Note that all Gx pixels, Gl through 

if (A < II and v< 71) G9, are assumed to be known and coincident with all 

cl5c n ^ w > ra corresponding Ax and C5 pixels. 

G5 - p There are three cases. Case 1 is when the nearest same 

else if (A <v) 5 colored neighbors to Ax are in the same column. The 

G5 = H following predictor is used. (A4 is used as an example.) 

' else 



05 = V A4=(Al+A7y2+<-01+2<?M77y2 

The key to this process is that both the green and toe ^ % fc when me nearest same colared neighbors to ^ 

chroma data must indicate a muumum of high spaual 10 oU ^ 

frequency information for a given orientation to be chosen nsed aj gx^m^ \ 
as the preferred orientation for the interpolation. If there is 

a large mount of high spatial frequency information in either A2=(Al4-A3V24<-Gi42C2-G3y2 
the green data or chroma data for a given orientation, it will 

L inflate the value of the corresponding classifier. This, in turn, t 5 Case 3 is when the nearest same colored neighbors to Ax 

reduces the likelihood for that orientation to be chosen as the are at the four corners. The following predictor is used. (AS 

preferred orientation for the interpolation. is used as an example.) 
Green Pixel Value Averaging 

Ater the green plane reconstruction, additional smoothing A5^Al+i^A7+/9y4^-<a-<3+4G5-<77-<»9y4 

on the original green pixel values can be perfonned to 20 We ^ ^ rovement for case 3. We fmm tte 

promote farther noiseredudon Colder the following post foH tWQ das ^ 
green plane reconstruction neighborhood: 

DN=\-CI+2G$-<j9MA1-A9\ 



01 G2 ' G3 25 DP=\-GMG$-<jJH\A3-A7\ 

G4' G5 Gtf 

G7 G8' G9 



These classifiers are composed of Laplacian second-order 

values for the green data and gradient values far the chroma 

where Gx is an original green pixel value and Gx' is a data. As such, these classifiers are sensing the high spatial 

predicted green pixel value. If two or more of the Gx* values 30 frequency information present in the pixel neighborhood in 

were interpolated using the method corresponding to slowly the negative diagonal (DN) and positive diagonal (DP) 

changing scene detail, then Gx is replaced with the follow- directions, 

ing value, G5": We then farm three predictors. 

G5MC2*+C4 , -K?6'+<»y4 3J A5A^+A3)/24<-01+2G5-G9y2 

One embodiment of this idea is to use G5 n when two or more A5*=(A3+A7y24<-03+ 2G5-OTy2 

values of Gx' were predicted using predictor A. This need A S^Ai + A^A9y4H-oi-GMG^cn-09y4 

not be, however, as any method of interpolation appropriate 

to slowly changing scene detail could be used in place of ^ These predictors are composed of arithmetic averages for 
predictor A. (Note that if all four predicted values were the chroma data and appr op riately scaled Laplacian second- 
derived using predictor A, then G5" becomes, equivalent^: order values for the green data, A5N is to be used when the 

preferred orientation for the interpolation is in the negative 
^^^2^204^^4^2010+20124013X16 diagonal direction within the pixel neighborhood. Similarly, 

where the indices refer to the expanded pixel neighborhood 45 A5P is , to * ™ ed wh . en P referTed for *e 

interpolation is the positive diagonal direction. ASA is used 

when there is no clear preference for orientation for the 

G1 interpolation. 

02 03' 04 The complete case 3 chrome interpolation process may 

G5 9T- 09 50 now be expressed as below. 



gio air on 

G13 



if (DN < DP) 
A5=ASN 



In effect, QT is a center weighted average.) ^as^asp^ 
Red and Blue (Chroma) Interpolation clsc 

The second pass of the interpolation fully populates the 53 as =asa 

red and blue color planes. In U. S. Pat No. 4,642 ,678, issued 

Feb. 10, 1987, Cok (the disclosure of which is incorporated ^ ^ Process both the green and the chroma data must 
by reference herein) disclosed the chroma interpolation indicate a niinimum of high spatial frequency information 
summarized below. Consider the following neighborhood for a ffv™ orientation to be chosen as the preferred orien- 

60 tation for the interpolation. If there is a large amount of high 
' spatial frequency information in either the green data or 

ai G2 A3 chroma data for a given orientation, it will inflate the value 

04 c5 06 of the corresponding classifier value. This, in turn, reduces 

A7 2! — toe likelihood for that orientation to be chosen as the 

65 preferred orientation for the interpolation. 
Gx is a green pixel, Ax is either a red or blue pixel and CS In practice, the case 3 chroma interpolation process may 
is the opposite color pixel to Ax (ie., if Ax is red then C5 be simplified, as below, for computational efficiency. 
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if (DN> 
AS 
else 

AS ^ ASP 



• DP) 
A5N 



10 



15 



20 



30 



35 



This simplification is achieved by defining the negative 
diagonal direction as the default preferred orientation for the 
interpolation when both negative and positive diagonal 
classifiers are equal. The number of occurrences in a typical 
image when the negative and positive diagonal classifiers 
are equal is so small that this simplification generally has 
negligible impact on the image quality of the final recon- 
structed image. 

The invention has been described in detail with particular 
reference to certain preferred embodiments thereof, but it 
will be understood that variations and modifications can be 
effected within the spirit and scope of the invention. 
PARTS LIST 
2 input section 
4 recording section 
10 exposure section 

12 image sensor 

13 color filter array 

14 output diode 
16 A/D converter 
18 image bufTer 
20 control processor 
22 digital signal processor 
24 removable memory card 
26 connector 
28 processing buffer 
30 display panel 
36 luminance section 
38 chroma section 
40 select best luma interpolation 
44 interpolate missing luma values 
46 select best chroma interpolation 
48 interpolate missing chroma values 

50 compute horizontal and vertical composite classifier 
values 

51 classifier threshold #1 test 

52 select slowly changing scene detail method of interpo- 
lation 

53 classifier threshold #2 test 

54 select rapidly changing scene detail method of interpo- 
lation 

55 classifier equality test 

56 select default method far interpolation 

57 select the interpolation method corresponding to the 
smaller value 

60 horizontal neighboring pixel test 

61 select horizontal interpolation method 

62 vertical neighboring pixel test 

63 select vertical interpolation method 

64 compute positive and negative composite classifier val- 
ues 

65 classifier equality test 

66 select default method for interpolation 

67 select interpolation method corresponding to the smaller 
value 

70 average red/blue values 
72 add green correction factor 
80 average green value 
82 add red/blue correction factors 
We claim: 

1. In apparatus for processing a digitized image signal 65 
obtained from an image sensor having color photosites 
aligned in rows and columns the image sensor generating at 



least three separate color values but only one color value for 
each photosite location, the apparatus including means for 
interpolating the color values for each photosite location so 
that each photosite has the three separate color values 
comprising: 
means for storing the digitized image signal; 
processor means operative with said storing means for 
generating an appropriate color value missing from a 
photosite location by the interpolation of an additional 
color value for such photosite locations from color 
values of different colors than the missing color value 
at nearby photosite locations, said processor including 
means for obtaining Laplacian second-order values, color 
difference bias values, and gradient values in at least 
two image directions from nearby photosites of the 
same column and row; 
means for adding the Laplacian second-order values, the 
color difference bias values, and the gradient values to 
define a classifier and for selecting a preferred orien- 
tation for the interpolation of the missing color value 
based upon the classifier; and 
means for interpolating the missing color value from 
nearby multiple color values selected to agree with the 
preferred orientation. 

2. The apparatus of claim 1 wherein, when the preferred 
orientation is horizontal, a color value is red, and the missing 
color value is green, adjacent horizontal green color values 
are averaged and horizontal red color values including the 
red color value provide a correction value. 

3. The apparatus of claim 1 wherein, when the preferred 
orientation is horizontal, a color value is blue, and the 
missing color value is green, adjacent horizontal green color 
values are averaged and horizontal blue color values includ- 
ing the blue color value provide a correction value. 

4. The apparatus of claim 1 wherein, the classifier include 
a horizontal classifier value and a vertical classifier value 
and when the horizontal classifier value and the vertical 
classifier value are both less than a predetermined value, and 
the missing color value is green, adjacent horizontal and 

40 vertical green color values are averaged to provide a cor- 
rection value. 

5. The apparatus of claim 1 wherein, the classifier include 
a horizontal classifier value and a vertical classifier value 
and when the horizontal classifier value and the vertical 
classifier value are both greater than a predetermined value, 
a color site is red, and the missing color value is green, 
adjacent horizontal and vertical green color values are 
averaged and horizontal and vertical red color values includ- 
ing a red color site value provide a correction value. 

6. The apparatus of claim 1 wherein, the classifier include 
a horizontal classifier value and a vertical classifier value 
and when the horizontal classifier value and the vertical 
classifier value are both greater than a predetermined value, 
a color site is blue, and the missing color value is green, 
adjacent horizontal and vertical green color values are 
averaged and horizontal and vertical blue color values 
including a blue color site value provide a correction value. 

7. The apparatus of claim 1 wherein, when the preferred 
orientation is horizontal, a color value is green, and the 
missing color value is red, adjacent horizontal red color 
values are averaged and horizontal green color values 
including the green color value provide a correction value. 

8. The apparatus of claim 1 wherein, when the preferred 
orientation is horizontal, a color value is green, and the 
missing color value is blue, adjacent horizontal blue color 
values are averaged and horizontal green color values 
including the green color value provide a correction value. 
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9. The apparatus of claim 1 wherein, when the preferred 14. The apparatus of claim 1 wherein, when the preferred 
orientation is negative diagonal, a color value is green, and orientation is vertical, a color value is green, and the missing 
the missing color value is red, adjacent negative diagonal red color value is blue, adjacent vertical blue color values are 
color values are averaged and negative diagonal green color averaged and vertical green color values including the green 
values including the green color site value provide a cor- 5 color s ^ vamc provide a correction value. 

rection value 1S - ^ G apparatus of claim 1 wherein, when the preferred 

10. The apparatus of claim 1 wherein, when the preferred orientation is positive diagonal, a color value is green, and 
orientation is negative diagonal, a color value is green, and theimssing color value u J red .adjacent posittve diagonal red 
the missing color value is blue, adjacent negativrdiagonal C0 OT values are averaged and positive diagonal green color 

\ 5 , " ' 7 ' ° , 5 _ values including the green color site value provide a car- 
blue color values are averaged and negative diagonal green 10 Tc ^ on f . 

color values including the green color site value provide a 16 ^ appafatus of cMm t whcn ^ pKdmd 

^f 0 !^ * , - , L - i- « . . orientation is positive diagonal a color value is green, and 

11. The apparatus of claim 1 wherein, when the preferred ^ va lue ^ ^ ue> adjacent positive diagonal 
orientation is vertical, a color value is red, and the missing y ue ^lor values are averaged and positive diagonal green 
color value is green, adjacent vertical green color values are 15 values including the green color value provide a 
averaged and vertical red color values including the red correction value, 

color site value provide a correction value. 17. The apparatus of daim 4 wherein the predetennined 

12. The apparatus of claim 1 wherein, when the preferred value is 25 when red, green and blue pixel values are 
orientation is vertical, a color value is blue, and the missing represented by a digital range corresponding from 0 to 255. 
color value is green, adjacent vertical green color values are 20 18. The apparatus of claim 5 wherein the predetennined 
averaged and vertical blue color values including the blue value is 200 when red, green and blue pixel values are 
color site value provide a correction value. represented by a digital range corresponding from 0 to 255. 

13. The apparatus of claim 1 wherein, when the preferred 19. The apparatus of claim 6 wherein the predetermined 
orientation is vertical a color value is green, and the missing value is 200 when red, green and blue pixel values are 
color value is red, adjacent vertical red color values are 25 represented by a digital range corresponding from 0 to 255. 
averaged and vertical green color values including the green 

color site value provide a correction value. * * * * * 
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